Search results for "Cohen's kappa"
showing 10 items of 31 documents
Is measurement of the gingival biotype reliable? Agreement among different assessment methods.
2019
Background To determine agreement among the most commonly used methods for assessing the gingival biotype. Material and Methods An electronic survey was sent to a sample of dentists practicing in Spain. The questionnaire was based on the evaluation of 5 cases involving different gingival biotype assessment methods. Dentists were required to classify the cases as having a “thin”, “thick” or “not able to classify” biotype. Each case was assessed using a frontal intraoral photo of the anterior teeth; an enlarged photo of the buccal aspect of the tooth with a periodontal probe inserted inside the sulcus; and the real thickness measured in mm with a calibrated needle. Agreement among the classif…
An evaluation of exposure metrics in an epidemiologic study on radio and television broadcast transmitters and the risk of childhood leukemia.
2009
Electric field strength values calculated by wave propagation modeling were applied as an exposure metric in a case–control study conducted in Germany to investigate a possible association between radio frequency electromagnetic fields (RF-EMF) emitted from television and radio broadcast transmitters and the risk of childhood leukemia. To validate this approach it was examined at 850 measurement sites whether calculated RF-EMF are an improvement to an exposure proxy based on distance from the place of residence to a transmitter. Further, the agreement between measured and calculated RF-EMF was explored. For dichotomization at the 90% quantiles of the exposure distributions it was found that…
Agreement between parent and child report on parental practices regarding dietary, physical activity and sedentary behaviours: the ENERGY cross-secti…
2014
Background Parents and their parenting practices play an important role in shaping their children’s environment and energy-balance related behaviours (EBRBs). Measurement of parenting practices can be parent- or child-informed, however not much is known about agreement between parent and child perspectives. This study aimed to assess agreement between parent and child reports on parental practices regarding EBRBs across different countries in Europe and to identify correlates of agreement. Methods Within the ENERGY-project, a cross-sectional survey was conducted among 10–12 year old children and their parents in eight European countries. Both children and parents filled in a questionnaire o…
Comparative analysis of impacted upper canines: Panoramic radiograph Vs Cone Beam Computed Tomography.
2016
Background The use of CBCT exam in the study of IMC is not new. However, it's still not known in what specific aspects CBCT exam shows a better result than then conventional exams. The aim of this study was to compare and conclude in what way the opinion regarding upper canine impaction differed when observing a panoramic image compared to the observation of a set of CBCT reconstructions. Material and Methods Twenty patients (10 males and 10 females) with a total of 28 impacted maxillary canines were identified from the database of the Department of Dentistry, Faculty of Medicine, University of Coimbra. For each canine, two different images were available: a panoramic image and a set of CBC…
Statement validity assessment: Inter-rater reliability of criteria-based content analysis in the mock-crime paradigm
2005
Methods. Three raters were trained in CBCA. Subsequently, they analysed transcripts of 102 statements referring to a simulated theft of money. Some of the statements were based on experience and some were confabulated. The raters used 4-point scales, respectively, to judge the degree to which 18 of the 19 CBCA criteria were fulfilled in each statement. Results. The analysis of rater judgment distributions revealed that, with judgments of individual raters varying only slightly across transcripts, the weighted kappa coefficient, the product-moment correlation, and the intra-class correlation were inadequate indices of reliability. The Finn-coefficient and percentage agreement, which were cal…
VII: Diagnosestudien: Einfache Maße für Validität und Reliabilität
2003
The evaluation of a new diagnostic or imaging device has to focus both on its diagnostic validity and reliability. Cohen's kappa coefficient can be used to assess the agreement of the new device's findings with those of an established diagnostic reference, it therefore presents a surrogate measure of validity. Additional measures of validity are sensitivity and specificity, which assess the order of agreement with the reference for positive and negative reference findings, respectively. The latter, however, can only be applied for binary reference findings. If discordant findings are observed, the McNemar test can be used to detect a diagnostic shift between diagnostic novum and reference. …
Validation of Semantic Analyses of Unstructured Medical Data for Research Purposes
2019
BACKGROUND: In secondary data there are often unstructured free texts. The aim of this study was to validate a text mining system to extract unstructured medical data for research purposes. METHODS: From a radiological department, 1,000 out of 7,102 CT findings were randomly selected. These were manually divided into defined groups by 2 physicians. For automated tagging and reporting, the text analysis software Averbis Extraction Platform (AEP) was used. Special features of the system are a morphological analysis for the decomposition of compound words as well as the recognition of noun phrases, abbreviations and negated statements. Based on the extracted standardized keywords, findings rep…
Test-retest reliability of survey items on ownership and use of physical activity trackers
2019
Background: Researchers are interested in using digital tools, such as physical activity trackers (PAT), to promote and measure physical activity. PAT is a fast-growing research area that measures movement therefore, reliable questions on the ownership and use of PATs among adolescent populations need to be developed. Objective: The aim of this study was to conduct an intra-rater test-retest reliability study on PAT survey items used for surveillance purposes among young adolescents in ownership and use of smartphone applications (apps) and heart rate monitors (HRM). Methods: Young adolescents (N = 755; 11-, 13-, and 15-year-olds) in the Olomouc region of the Czech Republic were recruited t…
Catching allergy by a simple questionnaire
2014
Background Identifying allergic rhinitis requires allergy testing, but the first-line referral for rhinitis are usually primary care physicians (PCP), who are not familiar with such tests. The availability of easy and simple tests to be used by PCP to suggest allergy should be very useful. Methods The Respiratory Allergy Prediction (RAP) test, based on 9 questions and previously validated by a panel of experts, was evaluated in this study. Results An overall number of 401 patients (48.6% males, age range 14–62 years) with respiratory symptoms was included. Of them, 89 (22.2%) showed negative results to SPT, while 312 (77.8%) had at least one positive result to SPT. Cohen’s kappa coefficient…
Diagnostic agreement in the assessment of orthodontic treatment need using the Dental Aesthetic Index and the Index of Orthodontic Treatment Need
2009
The aim of this study was to estimate the diagnostic agreement between assessments of orthodontic treatment need of a child population using the Dental Aesthetic Index (DAI) and the Index of Orthodontic Treatment Need (IOTN). A cross-sectional study of a representative random sample of children aged 12 ( n = 475) and 15–16 ( n = 398) years was carried out in the Valencia region of Spain. A Student's t -test was used to compare the DAI means by gender and age and a chi-square test to compare the proportions of the population in need of orthodontic treatment. To calculate the agreement between the two indices, intra-class correlation coefficient and Kappa statistics were employed. Of the 12-y…